Communication in networks with hierarchical branching 
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We present a simple model of communication in networks with hierarchical branching. We analyze 
the behavior of the model from the viewpoint of critical systems under different situations. For 
certain values of the parameters, a continuous phase transition between a sparse and a congested 
regime is observed and accurately described by an order parameter and the power spectra. At the 
critical point the behavior of the model is totally independent of the number of hierarchical levels. 
Also scaling properties are observed when the size of the system varies. The presence of noise in the 
communication is shown to break the transition. Despite the simplicity of the model, the analytical 
results are a useful guide to forecast the main features of real networks. 
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Nowadays, many challenging questions have arisen 
concerning the behavior of complex technological, eco- 
nomical, and social systems |l|. In particular, computer 
simulations of agents and their interactions (agent-based 
modeling) has become a widely used tool in our current 
understanding of their macroscopic behavior H. Spe- 
cially interesting is the study of hierarchical branching in 
networks because it seems to be the basic structure un- 
derlying complex organizational systems. Our interest is 
focused on the behavior of hierarchical structures formed 
by elements (or agents) that interact with each other 
via communication processes. This framework is espe- 
cially adequate to study e.g. Internet flow &-01, traffic 
networks [Bj , river networks and even communication 
flows in organizations pQ]. 

In this letter, we propose and study a very simple 
model of communication. The model includes only the 
basic ingredients present in a communication process be- 
tween two elements: (i) information packets to be trans- 
mitted (delivered) and (ii) communication channels to 
transmit the packets. Despite its simplicity, the model 
reproduces the main characteristics of the flow of in- 
formation packets in a network, and is general enough 
to allow the study of communication processes in many 
conditions: for example different capabilities of agents 
to transmit packets, and/or heterogeneity in the commu- 
nication channels (miscommunication, exogenous effects, 
etc.) represented by introducing disorder. We observe 
three different behaviors depending on the capability of 
agents to transmit packets. In particular, for a certain 
capability, we observe a continuous phase transition be- 
tween a sparse and a congested regime when the number 
of packets to deliver reaches a critical value. Near the 
transition point signs of criticality arise, we find large 
fluctuations, critical slowing down and power law behav- 
ior of power spectrum of the amount of information flow- 
ing in the network, in agreement with reported empirical 
data ||] . We provide a mean field estimation of the crit- 



ical point in good agreement with simulation results and 
we define analytically an order parameter to characterize 
the behavior of the system. 

The model is defined in the following way: the commu- 
nication network is mapped onto a lattice where nodes 
represent the communicating elements (for instance, em- 
ployees in a company, routers and servers in a computer 
network, etc.) and the links between them represent com- 
munication lines. In particular, we use hierarchical trees 
as depicted if Fig. ||, although most of the results reported 
hold when considering that the hierarchical branching is 
characteristic of the paths that information follows and 
not of the topology of the network itself. These struc- 
tures are characterized by two quantities: the branching 
factor, z, and the number of levels, m. From now on, we 
will use the notation (z, m) to describe a particular tree. 

The dynamics of the model is the following. At each 
time step t, an information packet is created at every 
node with probability p. When a new packet is created, a 
destination node, different from the origin node, is chosen 
at random in the network. Thus, during the following 
time steps i, t+1, . . . , t+T, the packet is traveling towards 
its destination: once the packet reaches this destination 
node, it is delivered (disappears from the network). The 
time a packet remains in the network is related not only 
to the distance between the source node and the target 
node, but also to the amount of packets in the network. 
In particular, at each time step, all the packets move 
from their current position, i, to the next node in their 
path, j, with a probability qij. We define Qij, quality of 
communication between i and j, as 
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where kap represents the capability of agent a to com- 
municate with agent (3 at each time step. For kap we 
propose: 



kap = ^apfina) 



(2) 



where ^af3 is a uniformly distributed random number 
in the interval [0, 1] representing the effects mentioned 
above for the directional connection between a and f3 
|0| , Ua is the total number of packets currently at node 
a, and /(n) determines how the capability evolves when 
the number of packets at a given node increases. 

Since any election of f{n) could be valid, we will study 
the general form 
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for n = 

for n — 1, 2, 3, . 



(3) 



with 7 > 0. The average number of packets delivered 
by a node a to another node /3 will be proportional to 
najijia nV ). Assuming the degree of homogeneity de- 
rived from the model, n^ ~ np, the former expression 
reads n]^'^ . It is straight forward to recognize three dif- 
ferent behaviors corresponding to three different values 
of 7 in the previous formula. For 7 > 1, the number of 
transmitted packets decreases as Ua grows. For small val- 
ues of the probability of packet generation per node and 
time step, p, all the packets are delivered and hence, after 
a transient, the system reaches a steady state in which 
the total number of packets, N , fluctuates around a con- 
stant value. However, if we increase p at some point the 
total number of packets will be so large that the network 
will not be able to handle them, A'^ will increase continu- 
ously and, at the end, no packets at all will be delivered 
to their destination. On the contrary, for 7 < 1, the num- 
ber of transmitted packets grows as Uq, does. Thus, the 
number of delivered packets increases as N grows until an 
equilibrium between generated and delivered packets is 
reached: at this point, N remains constant (except fluc- 
tuations). In case 7 = 1, the number of delivered packets 
is constant irrespective of the number of stored packets 
(note that this is consistent with simple models of queues 
P). This particular behavior is less obvious and will be 
treated accurately from the viewpoint of critical systems. 

As a first step, let us concentrate in the case ^jj = 
l,Vi,j. From simulations, we observe two different 
regimes and, as in the case 7 > 1, p plays the role of 
a control parameter. For small values of p, all the pack- 
ets are delivered while for large values of p, not all the 
packets can reach their destination, and A'^ grows in time 
with no limit. The key point is that, since the number of 
delivered packets is independent of A^, there is always a 
fraction of problems that are reaching their destination 
and the transition to the collapsed regime is continuous. 
This transition occurs for a critical value of p, Pc, whose 
exact value depends on the network parameters z and m 
(see Fig. g). For values of p smaller than but close to Pc, 
the steady state is reached but large fluctuations with 
long correlation times appear. 

At the subcritical region, the power spectrum of the to- 
tal number of packets, N{t), is well fitted by a Lorentzian 
characterized by a certain frequency, fc- As we get closer 



to Pc, we observe that /c ^- and the power spectrum 
becomes 1//^ for the whole range of frequencies. That 
means that the average time the packets remain in the 
network grows as we approximate the critical point (crit- 
ical slowing down). We have also analyzed the power 
spectrum of the number of packets at individual nodes, 
ni{t). The main result is that the power spectrum of 
N{t) is dominated by the top node which is the most 
congested: near pc, the power spectrum for this node is 
also 1//^. As one goes down in the hierarchy the number 
of packets diminishes and the power spectra have 1/ f^ 
tails with /3 decreasing from 2 to at the lowest level. 
The last result is consistent with the fact that the bot- 
tom agents deliver packets immediately and so ni(t) is 
a time series of peaks separated by Poisson distributed 
time intervals. As it is well known, this kind of series have 
white noise spectra. We have also checked other topolo- 
gies [Q and found that in a square lattice with closed 
boundaries the central sites have /3 ~ 1.2 (in agreement 
with Refs. 0,§|) whereas agents close to the boundaries 
are less congested and a much lower exponent for the tail 
(/3 ^ 0) is observed. 

As happens in other problems in statistical physics 
]l2[ , the particular symmetry of the hierarchical tree al- 
lows a mean field estimation of the critical point pc (al- 
though these calculation can be performed under more 
general conditions iQ). Since in the steady state regime 
there is no accumulation of packets, the number of pack- 
ets arriving to the top of the hierarchical structure (level 
1) per time unit, n°, is, on average, equal to the num- 
ber of packets that are created in one branch of the net- 
work and have their destination in a different branch (see 
Fig. Ill) . Since the origin and the destination of the pack- 
ets are chosen at random, from purely geometric consid- 
erations it is straightforward to estimate this number of 
packets per unit time as: 
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Within this mean field approach, it can be easily shown 
that it is indeed the top node which is the most congested. 
On the other hand, in our mean field calculation qi2 is 
the average probability that a given packet moves from a 
node in the second level to the top node and vice versa, 
and is given, as a first approximation, by qi2 = l/^nin2, 
where n\ is the average number of packets at level one 
and 712 is the average number of packets at each of the 
z nodes in the second level. Thus the average num- 
ber of packets leaving the top at each time step will be 
n\ = niqi2^ and the average number of packets going 
from the z nodes in the second level to the top will be 
n1 — zan2qi2, where a stands for the fraction of packets 
in the second level that are trying to go up (some of the 
packets in level 2 are, of course, trying to go down to 
level 3). 



At the critical point the top agent becomes collapsed 
and the communications between the first and the second 
level are much more congested than the communications 
between levels 2 and 3 so we can assume that a « 1. 
At this point, by imposing the steady state condition 
n'^ = n\ we arrive to the relations ni = zn2 and n" — ^/z. 
Using equation (H) we obtain the final expression for pc- 
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(5) 



Although strictly speaking the condition a — 1 pro- 
vides an upper bound to pc, equation (p) is an excellent 
approximation for 2 > 3, as depicted in Fig. g. 

The critical total number of generated packets, Nc = 
PcS, with S standing for the size of the system, can be 
approximated, for large enough values of z and m such 
that z™-i > 1, by 



N, 






(6) 



which is independent of the number of levels in the tree. 
It suggests that the behavior of the top node is only af- 
fected by the total number of packets arriving from each 
node of the second level, which is consistent with the 
mean field hypothesis. 

In order to characterize the transition, we introduce an 
order parameter: 
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where AA^ = N{t+At)~N{t) and (. . .) indicates average 
over time windows of width At. Essentially, this order 
parameter represents the ratio between undelivered and 
generated packets at the stationary state. For p > pc, the 
system collapses, (AA^) grows linearly with At and thus ?/ 
is a function of p only. For p < pc, (AA^) = and 77 = 0. 
As observed in Fig. y, and as may be expected from a 
properly chosen order parameter, when p is rescaled with 
Pc, the form of ry does not depend on the details of the 
structure of the network, z and m. 

As far as 77 does not depend on the structure of the 
network, we can study the simplest case (1, 2) in order to 
obtain an analytical estimation of the order parameter. 
In this case, the network consist of only 2 nodes, 1 and 2, 
interchanging packets. Since from symmetry considera- 
tions ni — n2, the maximum average number of delivered 
packets per time unit will be {ni ^n^)! ^n\ni — 2. Thus 
Pc = \ and with the present formulation of the model it 
is not possible to achieve the supercritical regime. How- 
ever, it is possible to extend p to be the average number 
of generated packets per node and time step and then 
p can be greater than one. In this case, for p > pc the 
number of packets delivered per time unit will be 2 while 
the number of generated packets will be 2p. Thus 



'n = 



p-l 



(8) 



in good agreement with simulated values (Fig. ^. In 
particular, near pc we have: 



77- (p-Pc)- 



(9) 



Now let us consider the case where ^ij take values uni- 
formly distributed in [0, 1]. Even for very small values of 
p, a particular realization of the disorder can provoke a 
very weak communication line and the congestion of the 
whole network. Thus there is no transition controlled by 
p. However, it is still possible to define the order pa- 
rameter as in (0), just considering that the average (. . .) 
has to be taken over time and over disorder realizations. 
As observed in Fig. ||, the existence of disorder destroys 
the phase transition acting as a random local magnetic 
field in a paramagnetic-ferromagnetic transition |14| and 
other physical systems |lq]. 

Again, it is possible to obtain an analytical expres- 
sion of the order parameter in the case of two nodes. 
As in the ordered case, the number of packets generated 
in a time step will be 2p. Now, however, for a partic- 
ular realization, ^12 and ^21, the maximum number of 
delivered packets will be 2-^/^12^21 • Thus, if C12C21 > P^ 
the system will reach the steady state and the configura- 
tion will not contribute to the order parameter, while if 
^12^21 < P^ the system will collapse and the contribution 
wiU be 7?{i2^2i = 1 - V£,i2£.2i/p- 

Thus we can define: 
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for 62C21 > P^ 
for C1261 < P^ 
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and the order parameter will be given by the average over 
the random variables: 



1 1 



Vip) = / d^i2 / cf6i'7(P,Ci2,6i)- 


It is straightforward to obtain the result: 

„.„)_/ l-4/(9p) for p>l 

^^^' ^ I (5p' - 3p2 lnp2) /9 for p < 1 



(11) 



(12) 



As depicted in Fig. ^, there is reasonable agreement be- 
tween this analytical expression and the points obtained 
by simulation, always keeping in mind the simplicity of 
our approach. 

Summarizing, we have studied a simple and general 
model of communication in a network with hierarchical 
branching. We have obtained some analytical results 
defining an order parameter and studying its behavior 
with respect to the relevant parameters of the model. 
The behavior of the system at the critical regime shows 



to be independent of the number of levels in the hierarchy. 
This phenomena shows that the main features of infor- 
mation flow in a network with hierarchical branching is 
determined by the branching of the first level. Although 
we are in a very temptative stage of the model, we think 
that this result can help to understand flow in real net- 
works, where this effect can dominate the global behav- 
ior of the system. Another interesting issue is the scaling 
observed in Fig. 0. From the viewpoint of organizational 
design, this scaling can be used to forecast the behavior 
of the organization when increasing or decreasing its size. 
The inclusion of a quenched randomness accounting for 
different kinds of interaction is not a hindrance for our 
theoretical analysis and we give an accurate behavior of 
the order parameter in this situation. The approach pre- 
sented here opens a line of research which will follow to 
study different dynamics and topologies. 



[12] 

[13] 

[14] 
[15] 



itative behavior of the system would be the same and 
similar calculations should be performed. 
D. Stauffer and A. Aharony, Introduction to percolation 
theory, Taylor & Francis (1992). 

A. Arenas, A. Diaz-Guilera, and R. Guimera, (unpub- 
lished) . 

J. Villain, Phys. Rev. Let. 52, 1547 (1984). 
A. Arenas and C.J. Perez, Physica 201 A, 614 (1993). 




FIG. 1. Typical hierarchical tree structure used for simula- 
tions and calculations: in particular, it is a tree (3, 4). Dashed 
line: definition of branch. 
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FIG. 2. Comparison between simulated (symbols) and an- 
alytical (lines) values for the critical probability of packet gen- 
eration, pc as a function of the branching factor z for hierar- 
chies with different number of levels: m — 4 (circles and full 
line), m — 5 (squares and dotted line), m = 6 (diamonds and 
dashed line) and m — 7 (triangles and dot-dashed line). The 
error bars are smaller than the symbol size. 




FIG. 3. Behavior of the order parameter in both cases with 
noise (filled symbols) and without noise (open symbols), for 
different structures: (6,7) (circles), (3,6) (squares), (5,4) (tri- 
angles). The lines represent analytical results obtained for the 
simplest case (1,2). 



